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Abstract: In the paper portfolio optimization over long run risk sensitive criterion is considered. 
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1 Introduction 


Many stochastic control methods are used in theoretical studies of portfolio management (cf. [23] 
and references therein). Among them, risk sensitive control is one of the most recognised ones. 
For infinite time horizon, any portfolio value process V and risk-averse parameter 7 < 0, the Risk 
sensitive criterion (RSC) function is given by 

:= liminf-lnFl[Vg]. ( 1 - 1 ) 

t—>-oo t 7 


Using this objective function in portfolio management gives us many advantages over the stan¬ 
dard theoretical methods, which are usually based on expected utility criterions. Let us alone 
mention difficulties associated with the estimation of model parameters or traceable difficulties 
which arise, when we try to compute optimal trading strategies for the realistic security market 
models [4], For RSC, applying Taylor expansion around 7 = 0, we get 


= liminf - 

t —^cx) 


E[lnVt] + AUar(lnUf) + 0 ( 7 kt) 
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which shows that this map could be seen as a measure of performance, as it penalise expected 
growth rate with asymptotic variance multiplied by risk-averse parameter 7 < 0. Of course, this 
only applies for problems, for which the last term (i.e. ,t)/t) vanishes, when t goes to infinity. 

Nevertheless, this assumption is satisfied for a lot of standard dynamics, as explained in [4, Section 
5], so (1.2) brings out the motivation, which led to this class of maps. We refer to [4] for a further 
discussion about economic properties of RSC. 

Following [1, 14], we would like to stress out the fact, that RSC could be seen as a risk-to-reward 
criterion. In fact, RSC could be considered as an Acceptability index [ 6 , 2 ], the map quantifying 
the tradeoff between portfolio growth and the risk associated with it. Many methods from risk and 
performance measurement theory could be directly applied to RSC, as we will show in this paper. 

From another point of view, RSC is a good objective function for many optimal control problems 
related to (controlled) Markov decision processes both on finite and infinite time horizons (cf. 
[18, 17, 8 , 5] and references therein). In particular, the connection to portfolio optimization was 
shown in [3], where RSC was applied to continuous time infinite time horizon, and a version of 
Merton’s intertemporal capital asset pricing model [21] was considered. The analogous study for 
discrete time market model was done in [25]. 

Because of that, we have decided to present our results in such a way, that they might be 
interesting both for specialists from risk analysis, in particular studying dynamic growth indices, 
as well as for specialists from risk sensitive control Markov decision processes. 

There are many sophisticated methods, which guarantee the existence of the solution to Bellman 
equation associated with RSC. Let us alone mention the vanishing discount approach [16] or the 
fixed point approach [ 8 ]. The assnmptions under which the existence of the solntions is gnaranteed 
are nsually related to ergodic properties of the considered process [ 8 , 19, 17, 16]. The most recent 
results relate to localized Doeblin’s conditions [5] and Markov splitting techniques [9]. The theory 
of RSC is also strictly connected to multiplicative Poisson equations [9] and Issacs equations for 
ergodic cost stochastic dynamic games (cf. [16, 11, 7] and references therein). 

In the paper, we generalize the results of [25] in the sense that we consider market model 
with more general economic factors, which are not necessarily uniformly ergodic, and consequently 
studying Bellman equation we have to work with suitable weight functions. Such more general 
economic factors were studied for Black Scholes market in the paper [3] and then continued for 
continuous time general diffusion models in [22]. In this paper we are studying discrete time model 
and we were motivated by attempts to generalize risk neutral results of [15] to the risk sensitive 
portfolio by the paper [24] . 

The main novelty of the paper is that we obtain, using weighted span norm contraction method, 
the existence of solutions to suitable Bellman equation. Consequently, our paper can be applied to 
more general dynamics of the market than in [25]. Furthermore we solve a risk sensitive control 
problem with unbounded solutions to the Bellman equation. 

This paper is organized in follows. Section 2 is the general setup. We state here all assumptions 
core to our study (e.g. on dynamics, control, etc.). Next, in Section 3 we recall some basic notation 
for the weighted norms and span-norms. In Section 4 we present the main results of this paper, 
i.e. we state the Bellman equation and show when it could be solved. In Section 5 we show how to 
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connect Bellman equation to the initial investment problem. In particular we discuss how, given a 
solution to Bellman equation, construct the optimal strategy and when it is possible. Finally, in 
Section 6 we show exemplary dynamics, that could be ht to our model. 

2 Preliminaries 

Let (n, {J'tligT; P) be a discrete-time hltered probability space, where T = N, Ju is trivial and 
T = UteT ■ Moreover, let := F, P) denote the space of all (a.s. identified) J^-measurable 

random variables. 

We will assume that the market consists of m risky assets (e.g. stocks, bonds, derivative 
securities) and k economical factors (e.g. rates of inflation, short term interest rates, dividend 
yields). Prices of m risky assets will be denoted by S'* = (S^)tgT for (i = 1,... ,m) and levels of 
k economical factors will be denoted by Xl = (Xj)tg'f for (j = 1,... ,/c). For simplicity, we will 
write S := {St)tgf and X := (Wt)igT, where St = {S},..., S™) and Xt = {X },..., X^). 

We will use A to denote the set of all [/-valued adapted processes, where U is a compact 
subset of M"*. Elements of A will correspond to all admissible portfolio strategies H := 
where Ht = (if /,..., H^^) and i/* = {HDt^i is a part of capital invested in i-ih risky asset (for 
i = l,...,m). Furthermore, we will use notation = (V)'^)tgT to denote the portfolio value 
process corresponding to strategy H. 

Throughout this paper we will make the following assumptions: 

(A.l) The filtration {Ft}tgi will be generated by a sequence of k+m stochastic processes denoted by 
VF* = (B7)tgT for (i = 1,..., A: -|- m). Moreover, Wt = (hF/, • • •, VF/*^*”) will be independent 
of Ft and Law{Wt+i) = Law{Wt), i.e. IF := (Wt)t£T will form a sequence of i.i.d. random 
vectors. 

(A.2) The factor process X will be Markov and will admit the following representation: 

Ao Xt+i = G{Xt,Wt) := iG\Xt,Wt),... ,G’^{Xt,Wt)), 

where G*: x is a Borel measurable function, continuous with respect to the 

first variable (for i = 1,..., k)- 

(A.3) For any H £ A, we will assume that the portfolio dynamics will be of the form 

= Fo, = 

for [ G T, where Fq > 0 and F: x [/ x M^+"* —>■ M is a Borel measurable function, continuous 

with respect to the first two variables. 

(A.4) We will assume that for any t G T, x G M^, h £ U we have 

uj{G{x, w)) < ai{w) + biu}{x), 

\F{x,h,w)\ < a 2 {w) + b 2 U}{x), 


( 2 . 2 ) 

(2.3) 
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for Borel measurable functions 01,02: M+, constants bi € ( 0 , 1 ), 62 > 0 and con¬ 

tinuous measurable function cj: —>■ [0,oo), which we shall refer to as the weight function. 
Moreover, we will assume that for any 7 G M, 


where pL : 


p'^iaiiWo)) eM and p'^ia2iWo)) € 
is the entropic utility measure, i.e. 


p^{X) := { ^ 

’ \ E[X] 


ilnE[exp(7X)] if 7 / 0, 
if 7 = 0. 


( 2 . 4 ) 


( 2 . 5 ) 


(A.5) For any i? > 0, there exists a constant c > 0 and probability measure v, such that 

inf P[G(x, Wo) G A] > cv{A), A G B(M^), (2.6) 

x&Cr 

where Cr = {x G : oj{x) < R}. 

Assumptions (A.l) and (A.2) are classic conditions imposed on the probability space and the 
factor process, respectively. 

Assumption (A.3) is technical - it allows to model portfolios through log-returns, rather than 
value processes (see e.g. Example 6.1 or [25] for more details). 

Assumption (A.4) has a financial interpretation. The state-space constraints bi and 62 intro¬ 
duced in (2.2) and (2.3) say that in our model we allow only w-growth (i.e. growth proportional to 
the growth of to) with respect to the state space. In particular, inequality (2.2) might be seen as a 
form of the geometric drift condition imposed on X (cf. [15]). On the other hand, assumption (2.4) 
allow us to have control over the entropy of the noise part. In a more probabilistic setting, it is 
equivalent to the statement that the moment generating functions for ai(Wo) and a 2 {Wo) exist. In 
particular, we might say that the utility (or risk) of a single period log-return at time t measured 
by (or —p'^) must be finite for any simple trade (in any fixed state) and in fact it is bounded by 
± 02 ( 144 ) plus some constant (dependant on the state). Please note, that this assumption is rather 
weak, and fulfilled by standard models, which describe log-returns as processes of the form 

k-\-m 

Fix, h, Wt) = a(x, h, Wt) + 

where Wt is a random vector with multidimensional normal distribution and functions a and b 
satisfy o;-growth constraints. Then, the function 02 could be constructed using random variables 
min(lT/,..., Wt^+^) and max(iy/,..., 

Assumption (A.5) is a (local) minorization property. Combined with the geometric drift condi¬ 
tion, it allow us to exploit the ergodic properties of X (cf. [15]). Please note that setting = 0, for 
any i? > 0 we get C = Consequently, in this particular case, (A.5) becomes a global Doeblin’s 
condition, which is equivalent to the uniform ergodicity of process X. On the other hand, if u is 


Long run risk sensitive portfolio with general factors 


5 


unbounded and Cr is compact for any R > 0, then (2.6) is directly linked to the (local) mixing 
condition, i.e. the statement that for any fixed compact snbset K (of M^), we get 


sup sup |P[G(x,ld^i) G A] - F[G{y,Wi) G A]| < 1. (2.7) 


The main goal of this paper is to optimize the risk sensitive cost criterion given by (1.1), i.e. 


gR{V) = liminf — 
t—^oo t y 

where 7 < 0 is a hxed risk aversion parameter and V is portfolio value process. In other words, 
given the set A and dynamics of for any H ^ A, we want to solve the optimal stochastic control 
problem 

sup ( 2 . 8 ) 

hgA 

Using the entropic representation of (see [1] for more details) and (2.1), for any H £ A, we get 

= l.p.nf g.,IT.))^ 


)-oo 


t 




t 


where is entropic utility measure given by (2.5). Note that the hrst equality in (2.9) provides 
another financial interpretation of the RSC. The logarithmic transform of allow us to measure 
the cumulative growth (log return) at time t, while the map pL is used to evaluate its (entropic) 
utility. Then, we divide the outcome by t to normalise it in time and use liminf to measure (a 
worst case robust version of) the long-time efficiency of the value process (cf. [ 1 ]). 

Under the above assumptions, from (2.9), it is not difficult to see, that the optimal value of the 
problem (2.8) will be finite, which is in fact the statement of Proposition 2.1. 

Proposition 2.1. Let 7 < 0. Under assumptions (A.1)-(A.4), we get 

—00 < sup gPiy^) < 00. 

HeA 


Proof. Using (A.3) and (A. 4), for any H £ A and t G T, we get 

t-i t-i 

<Y,a2{Wi) + b2u:{Xi) 

i=0 

< ^ ( a2(iy.) + 62 ( FMXo) + 6iai(kP*-i) 


i=0 




i=0 


j=0 


< 


^a;(Xo) + UiW,) + . 

i=0 ^ 
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As the entropic utility measure pL is monotone, translation invariant, additive for any two 
independent random variables and law invariant [20], for any t G T, we get 




^ F{Xi, Hi, Wi) \ < ,^uj{Xo) + ^ (a2(Wi) + 

\i=0 / ^ i=0 ^ ^ ' 


l-6i 


a;(Xo) + tp^ ( a2(f^o) + 


Consequently, using (2.9) and (2.4), for any H £ A, we get 
(^T'(F^) = hminf-^- <- 

t^OO t 


< p^ ( a 2 {Wo) + Y-^^oi(^o) ) < oo. 


The proof of the other inequality is analogous. 


□ 


3 Weighted norms 


In assumption (A.4) we have introduced measurable and continuous function w: ^ [0, oo), which 
we referred to as the weight function. Following [15] let us now recall basic notation regarding those 
function. We shall denote by Ctj(M^) the set of all continuous and measurable functions / : —>■ R, 
such that the w-norm of / is bounded, i.e. 


:= sup 

xGIR'' 


\fix)\ 

1 + Uj{x) 


< oo. 


Next, we define w-span seminorm of / G C,^(R^) by 


/(^) - f(y) 

j-span ■— sup / \ I / ^ ■ 

x,yeR>‘ 2 + U}{x) + uj[y) 


Remark 3.1. The classic span-norm of function /: R^ R (cf. [18] and references therein) is 
usually defined as ]|/||span = sup^, f{x) — inf^ /(y). Note that in our framework, using w = 0, we get 
ll/IU-span = fix) _ Moreover, for any bounded weight function w, we know 

that jj • 11 span and jj • [Joj-span are equivalent. 

For any /3 > 0 we shall also define the weighted (semi) norms given by 


11/11/3,0; := sup 
II/II/3 ,(:j-span • 


l/(a;)| 

1 + /3a;(x) ’ 


Please note that for any /3 > 0 and c > 0, the function a;': R^ ^ [0, oo), given by u!'{x) = /3u}(x) + c 
is also a weight function. Let us now recall some basic properties of weighted norms and related 
span norms. 
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1) For any P > 0, the norms || • ||^ and || • are equivalent. 

2) For any /3 > 0, the seminorms || • \\u)-span and || • Wg^uj-span equivalent. 

3) For any 0 < /3 < 1 and f G we get \\f\\ui-span < \\f\\0,Lj-span- 

4) For any f € Cuj{R’") we get infcgR ||/ + c||w — ll/lltj-span' 

5) Let f € C^(M^) and c € M. Then ||/ + c||^ = ||/||tj-span if and only if c ^ [ci,C 2 ], where 

inf {/(x) + (1 + Oj{x))\\f\\u:-span} : 
xeM'' 

sup {/(x) - (1 + Uj{x))\\f\\^.span} ■ 
xeM'' 

Moreover, there exists cq G {ci,C 2 }, such that 


Cl = 

C2 = 


= — inf 




Lj-span} ? 

(3.1) 

u}-spa7i\ • 

(3.2) 

fix) + Co 

1 \ , .f \ ‘ 

(3.3) 


X 


Proof. The proof of properties 1), 2) and 3) is straightforward and hence omitted here. 
4) The proof is based on [15, Lemma 2.1] and is recalled for completeness. Let / G 
For any x G we get |/(x)| < ||/||aj(l +^^(a^))j which in turn implies 


f{x) - f{y) ^ ||/|U[2 + a;(x)+a;(^)] 
2 + uj{x) + ui{y) ~ 2 + uj{x) + uj{y) 

Consequently, for any c G M we get 


x,y G 


||/||tj-span — 11/ T cjloj-span ^ \\f + cjja;. 


(3.4) 


Let us now prove the other inequality. Noting, that we could take a ■ f instead of /, for some a > 0 
and the proof for the case ||/||tj-span = 0 is trivial, without loss of generality we could assume that 
ll/L-span = 1- By the definition of || • L-span and the fact that ||/L-span = 1, we get 

fix) - [fiv) + 1 + aj{y)] < 1 + a;(x), 

for any x,y € ISf. Thus, ci := — inf^^gj^i, {fin) + 1 + aj{y)} G M and for any x G we get 

/(x) + Cl = sup [/(x) - f{y) - 1 - uj{y)] < 1 + uj{x). (3.5) 

yGR'' 

On the other hand, for any x G M^, we get 

/(x) + Cl = sup [/(x) - f{y) - 1 - w(y)] > /(x) - /(x) - 1 - a;(x) = -(1 + w(x)). (3.6) 

i/eK'= 
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Combining (3.5) and (3.6), we get ||/ + ci||,j < 1. This, together with (3.4), concludes the proof of 

4 )- 

5) Let / € Ctj(M^) and let c G M. Repeating and slightly modifying the proof of 4) it is easy to 
check that 

11/ + Cl\\u) = 11/ + C2||a; = 11 / 11 tj-span ■ (3.7) 

If c G [ci, C 2 ], then there exists a G [0,1] such that c = aci + (1 — a)c 2 . Thus, using (3.4) and (3.7), 
we get 

ll/L-span < 11/ + c\\uj < a\\f + CiWu; + (1 “ a)\\f + C2\\u; = ||/L-span- 
On the other hand, we know that if ||/ + c\\uj = ||/||aj-span) then for any x G we get 

— ll/IU-span < 1 -)- uj{x) ~ 

Because of that, for any x G we have 


-fix) - (1 + w(x))||/||^_span < C < -/(x) + (1 + a;(x))||/||a;-span, 


and consequently ci < c < C 2 . This completes the first part of the proof. Let us now show that 
there exists (at least one) cq G [ci,C 2 ], satisfying (3.3). 

Given / G for any c G M we define 


a+(c) := sup 


fiz) + c 


g]gfc 1 + Uj{z) 


and U-(c) := — inf 


fiz) + c 


1 + ojiz) 


It is easy to note that a+(-) is finite, continuous and non-decreasing, while a_(-) is finite, continuous 
and non-increasing. Moreover a+(c) —>- 00 , as c —>• 00 , and a_(c) —>■ 00 , as c —>■ — 00 . Thus, there 
exists Co G M, such that a+(co) = a_(co). Moreover, for any c > cq we get 

11/ -k c\\^ = max(a+(c),a_(c)) > a+(co) = max(a+(co), a_(co)) = ||/ -k co|U, 


while for c < cq w get 


11/ -k c\\uj = max(o+(c),a_(c)) > a_(co) = max(a+(co), a_(co)) = ||/ -k cqIU- 


Consequently, 

a+(co) = a-(co) = ||/ -k co|U = inf ||/ -k c\\aj = ||/|U-span- (3.8) 

cGR 

By the first part of the proof of 5), we know that cq G [ci,C 2 ]. If cq is equal to ci or C 2 , then the 
proof is finished. On the contrary, let us assume that cq ^ {ci,C 2 }. By using monotonicity of o+(-) 
we have a+(co) < o+(c 2 ) and by (3.8) using 

11/ + Collin = 11/ -k Cilia; = 11/ + C2||a; = max(a+(c2), O-(C 2 )), 

we obtain o+(c 2 ) = a+(co). Consequently a+(-) must be constant on [co,C 2 ] and as a convex 
nondecreasing mapping it is in fact constant on (—cx),C 2 ]. Using similar arguments, we get that 
a_(') as a nonincreasing convex mapping must be constant on [ci,oo]. Consequently, both ci and 
C 2 satisfy (3.3), which concludes the proof. □ 
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Remark 3.3. We might get ci ^ C 2 - Let f{x) = 0 for |a;| < 1, and f{x) = |a; — L| for |x| > 1. Then, 
for uj{x) = Ixj, it is easy to check that ||/||a;-span = 1, ci = —1 and C 2 = 1. Moreover, one might 
look at Co as a centering constant for weighted /, i.e. the constant, such that the distance from 0 
to sup^-gj^fc is the same as the distance from 0 to inf^-gj^fe particular, the || • ||a;-span 

seminorm might be considered as a || • ||a) norm for centered function, which provide some insight 
for 4) in Proposition 3.2. 

Proposition 3.2 implies that for any /3 > 0, c > 0, / : —>• M and oj' defined by oj'{x) = 

j3uj{x) + c, we get 

WfWuj < oo ll/ll^/ < oo, (3.9) 

which in turn implies 

C^(]R'=) =0(M'=). 

Moreover, if a family of functions is uniformly bounded wrt. w-span norm, then it is uniformly 
bounded wrt. w'-gpan norm. 

Next, for any /3 > 0, two probability measures Qi and Q 2 on and the corresponding 

signed measure El = Qi — Q 2 ) let ||Bl||, 3 ^^_var denote its weighted total variation norm given by 

||EI||/3,a;-var = / {l + l3u;{z))\M\{dz) = sup [ ip{z)M{dz), 

JR'^ JR'' 

where |]HI| denote the total variation of H, i.e. 

|lHi| = IaH — ly^cEI, 

for A being a positive set for measure El (obtained e.g. using Hahn-Jordan decomposition). In 
particular (for ui = 0), let ||EI||var denote the the standard total variation norm [18], i.e. 

P||var:= / m{dz) = 2 sup |Ql(P-Q 2 (P|. 

JR'' y4eB(R'') 

4 Bellman equation 

Using representation (2.9), it is not hard to see that the Bellman equation corresponding to (2.8) 
is of the form 

v{x) + X = sup p(F(x, h, Wo) + v{G{x, Hq))), (4.1) 

h€U 

where A € M, n € Caj(lK^)j x € and w: —)■ [0, 00 ) is a weight function from (A.4), for which 

the corresponding Bellman operator 

p/(x) := sup P(T(x, h, Wo) + f{G{x, Wq))), / G C^(M'^), (4.2) 

h&U 

satisfies certain contraction properties. 




Long run risk sensitive portfolio with general factors 


10 


For computational convenience, let us introduce the associated Bellman equation 

u{x) + A 7 = 7 sup pL{F{x, h, Wo) + ^ 0 )) ^ 

h&u 7 

= inf 
h£U ^ 

= T~fU{x), (4.3) 

where u{x) = 'yv{x) and where the corresponding Bellman operator takes the form 

T^f{x) := 7 ^ 7 = mf / G C(M^). (4.4) 

Remark 4.1. Bellman equation (4.3) is strictly connected to the Multiplicative Poisson Equation 
(MPE) defined for corresponding 7 (cf. [9] and references therein). Sufficient general conditions for 
which there exists a solution to MPE in the classic case (i.e. using ergodicity conditions and span 
norm or vanishing discount approach) could be found e.g. in [ 8 , 19, 17, 16]. For a more general 
conditions (obtained using splitting Markov techniques or Doeblin’s condition) see e.g. [9, 5]. Also 
using robust representation of the risk measure (i.e. —pL) [ 12 ], one could notice that equation 
(4.1) corresponds to the Isaacs equation for ergodic cost stochastic dynamic game (cf. [16, 11] and 
references therein). 

Proposition 4.2. Letj < 0. Under assumptions (A.1)-(A.4), the operators R-y andT-y transforms 
the set C(^(M*^) into itself and for f G Ca;(M^) the mapping (—oo,0) x 9 ( 7 ) 3 :) T^f{x) is 
continuous. 

Proof. We will only show the proof for R.y, as the proof for T.y is analogous. Let / G C^(M^) and 
7 < 0. We know that there exists M > 1, such that for all x G M^, we get |/(x)| < M{oj{x) + 1). 

First, let us prove that ||ii.y/||tj is finite. Using the fact that is monotone and translation 
invariant as well as (A. 4), for any x G M^, we get 

Ryf{x) < p'^{a 2 {Wo) + b 2 (n{x) + M{uj{G{x,Wo)) + 1)) 

< p^a 2 iWo) + b 2 Ujix) + Mai (Wo) + Mbiu>{x) + M) 

= (62 + Mbi)u{x) + M^(a 2 (Wo) + Mai(Wo)) + M, 

as well as 

R-,f{x) > -(62 + Mbi)uj{x) + p'^{-a 2 {Wo) - Mai (Wo)) - M. 

Consequently, noting that R.yf G Ctj/(R^) for 

uj'{x) = (62 + M 6 i)a;(x) + |//^(a 2 (Wo) + Mai(Wo))| + |/i^(-a 2 (Wo) - Mai(Wo))| + M, 

and using (3.9), we conclude that is finite. 

Second, let us prove that the mapping (—oo,0) x 3 ( 7 ,x) R^f{x) is continuous. Let 
{{7n,Xn,hn)}neN be a sequence such that 7 „ < 0 G hn & U and {'-fn,Xn,hn) -3 ( 7 ,x,/i), 
where 7 < 0, x G and h ^ U. By (A.2) and (A. 3) we know that 

^■yn[F{x„,h„,Wo)+f{G{x^,Wo))] ^'f[F{x,h,Wo)+f{G{x,Wo))]^ 
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As the weight function uj is continuous and finite-valued, we know that y := sup„gf^ti;( 3 :„) < oo. 
Moreover, using (A.4), we get 

0 < g'yr.[F{Xn,hr^,Wo) + f{G{Xr^,Wo))] < g70 [<12 ( Wq )+Mai ( Wq ) + ( 62 +Mfei )y+M] 

with 7 o such that for any n we have 7 ^ < 70 . Noting that e'ro[°' 2 (Wo)+Mai(Wo)+(b 2 +Mbi)y+M] ^ 
by dominated convergence theorem, 

^^ln[F(x„,hn,Wo)+f{G{xr.,Wo))]l^ ^^l[F(x,h,Wo)+f (Gix ,Wo))]l^ ^ 


and consequently 


{F{xn, hn, Wo) + /(G(x„, Wo))) ^ g^F{x, h, H^o) + f{G{x, Wq))). 

Let h2 := argmax^jgfj pL{F{z, h, Wq) + f{G{z, VLo))), for any z € U (note that U is compact). Due 
to continuity of the function (7, x, h) 1 -^ fF'{F{x, h, Wq) + f{G{x, Wo))); we also know that 

{F{xn, hZl,Wo) + f{Gixn, Wo))) ^ y^F{x, hZ, IDo) + /(G(x, Wo))), 

which imply continuity of (7,0;) R^f{x). □ 

We are now ready to formulate the main result of this paper. 

Theorem 4.3. Let 7 < 0. Under assumptions (A.1)-(A.5), for sufficiently small /3 > 0, the 
operator is a local contraction under || • W/s^i^span, *-e. there exist functions f : M+ (0,1) and 
L : M+ (0,1) such that 


WT'yfl — Ty/2||/3(Af) ^LO-span < L(M)||/i - /2||/3(M) ,to-span 1 

for /i,/2 G such that \\fi\\cj-span < M and \\f2\\u;-span < M. 


The proof of Theorem 4.3 will be split into three lemmas which we will now formulate and 
prove. Before we do this, let us introduce some helpful notation. 

Let (D, J'ljPi) be a probability space which corresponds to random variable Wo- For any 
/ G X G and /i G 17 we will use the following notation 


h(x,f) := ^argm.aKfF{F{x,h,Wo) + -f{G{x,Wo))) 
h&u 7 

= arg min \r,^[eWUFWo)+f(G(x,Wo))^^ 
heu 

Q{xj,h) ■= 7 arg min [iEq[F(x, h, Wo) -b -f{G{x,Wo))] - -iL[Q||Pi] 
QeMi L 7 7 

Eq[ 7 F(x, h, Wo) + f{G{x, Wo))] - 77[Q||Pi]l, 


(4.5) 


= arg max 
QGAti 


(4.6) 
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where Mi := Mi{fl,Fi) denote the set of all probability measures on (11, Ji) and -ff[Q||Pi] is the 
relative entropy of Q wrt. Pi, i.e. 


^[QI|Pi] 


EQpn^g] ifQ<Pi, 
+00 otherwise. 


Objects defined in (4.5) and (4.6) might be non-unique in the sense that argmin (or argmax) 
might define a set, rather than a single element. Nevertheless, with slight abuse of notation, we 
take any fixed maximizer of (4.5) and assume that hxj € U. To have a unique representation of 
measure Q(^xj,h)^ use so called Esscher transformation [13]. Before we write the explicit form of 
Q{x,f,h)^ US give a more specific comment. The measure Q(x,f,h) corresponds to the minimizing 
scenario in the robust (dual) representation of the entropic utility pL. Indeed (see e.g. [7]), for any 
Z S L‘^(11, J-*!,Pi), such that G T^(n, J^i,Pi), we get 


p^{Z) 


inf [EqZ --77[Q||Pi] 
QGXi L 7 


(4.7) 


To show that 

Z = F{x,h,Wo) + -f{G{x,Wo)) 

7 

is such that G L^(ll, J^i,Pi), it is enough to note that ||/||a; < oo and use (A.4). Then, we 

get 

Z G J'i,Pi) and G J-i,Pi), 

which combined with the fact that for any 7 < 0 we get 




concludes the proof. Then, as shown in [7, Proposition 2.3], we could define the minimizer of (4.6) 
through Esscher transformation of Z, i.e. the measure Q(xj,h) given by 


^'rF(x,h,w)+f(G(x,w))-p^ 

Q{x,f,h){dw) = ^^^^p(x,h,Wo)+f(G(x,Wo))j ■ 

We will also define the measure Q{x,f,h) on M^, by 

\f{x,f,h)[^) ^^'rFix,h,Wo)+f(G(x,Wo^ 

Finally, for any f,g^ and x,y G we shall write 

'^x,y •= *^(a;,/T7,a)) “ '^{y,g,h(y,f))- 


A G 


(4.8) 


(4.9) 


(4.10) 


We are now ready to introduce Lemma 4.4, Lemma 4.5 and Lemma 4.6. 
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T^f{x) - T^g{x) - mfiv) - T^g{y)) < ||/ - 9\\p,u,-span\\^i%\\p,u,-var, 
for any f,g & C^(]R^), and /3 > 0. 

Proof. Let f,g& C^(]R^), G and let /3 > 0. Using (4.5) we get 


T'yfix) = -i sup p?{F{x,h,Wo) + -f{G{x,Wo))) 
heu 7 

< 'yp^{F{x,h(^^^gpWo) + ^f{G{x,Wo))) 


Kq[jF{x, /i(,,g), lUo) + f{G{x, lUo))] - F[Q||Pi 


= sup 
QgXi(Pi) 

= [lFix,h^^^gpWo) + f{Gix,Wo))] - 

Now, using (4.6) we get 

T-yg{x) = 7 sup p'^{F{x, h, Wq) + -g{G{x, Wq))) 


heu 


7 

1 


= 7U^Fix, /i(,,g), lUo) + -g{G{x, Wq))) 


= sup 
Qe74i(Pi) 


Eq[jF{x, h^^^gpWo) + g{G{x, lUo))] - ^[Q||Pi] 
[lF{x,h(^^^gpWQ) + g{G{x,WQ))\ - -H'[Q(a:,/,h(,,g))I 
Combining (4.12) and (4.13) we get 




T.,Ux) - r,j(x) < I/(G(x, Wo)) - g(G{x, lVo))| 


< 


/ [/(^) -5(^)]Q(x,/,))( rf^)- 

Switching / with g in (4.14), and doing similar computations for y G M^, we get 

T^giy) - T^f{y) < [ [g{z) - /(2)]Q(y,g,fc( ^^)idz) 

Combining (4.14) with (4.15) and recalling notation (4.10), we get 

T^fix) - T^g{x) - {T.yf{y) - T^giy)) < [ [f{z) - g{z)]Ul’3y{dz). 

Jr'= 


We know that for any c G M, we get 


f{z) -g{z)+c 


[ [f{z) - g{z)]Bll’l{dz) = f ■' ^ [I + Pu{z))nl;3[dz). 

Jmf 7 r'= -L + 


(4.11) 


(4.12) 


(4.13) 


(4.14) 


(4.15) 


(4.16) 
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Let ^4 C denote a positive set for a signed measure (obtained e.g. using Hahn-Jordan 
decomposition) and for any c € M let 


a+(c) := sup 
zeK* 


f{z)-g{z) + c 
1 + I3u}{z) 


and 


a-ic) := — inf 
zeiR'= 


f{z)-g{z) + c 
1 + I3u){z) 


Then, for any c € M, we get 

[ [f{z) - giz)]Ml’l^y{dz) <a+{c) [ {1 + /3uj{z))Ml’l{dz) - a-{c) [ {I + /3uj{z))Ul’l{dz). (4.17) 
From Proposition 3.2 we know that there exists cq G M, such that 


®+(co) O—(cq) 11/ 5ll/3,aj-span' 


Thus, from (4.17) we get 

[ [f{z) - g{z)]Ml’^l{dz) < 11 / - 511 / 3 ,( 4 . 18 ) 

jRf^ 

which together with (4.16) concludes the proof of (4.11). 

□ 


Lemma 4.5. Let 7 < 0. Under assumptions (A.1)-(A.4), for any fixed M > 0 and G ( 61 ,1), 
there exists > 0 , such that 

\\lhll%h,ui-var < + /3(</>w(x) + (j)U]{y) + 2a^), (4.19) 

for any x,y gR'" and f,g G C^(M^) satisfying \\f\\uj-span < M and \\g\\uj-span < M. 

Proof. For any x,y gR^ and f,g G Caj(M^) we get 


mlnku 


/ {1 + fiu{z))\Ml’l\{dz) 

Jr* 

[ \Mi%\{dz) + 13 [ u;{z)\Uf’l\{dz 
Jr* Jr* 


— IPxl^llvar + 




Thus, to prove (4.19) it is sufficient to show that for any hxed M > 0 and 4> G (fei, 1), there exists 
00 > 0 , such that 

^{z)Q(x,f,h){dz) < 4>uj{x) + Q! 0 , (4.20) 


/ 

Jr* 


for any h G U, x gR’^ and / £ C(j(]R^) satisfying 

Let M > 0 and fi G (&i, 1). Using (4.8) and (4.9) we get that (4.20) is equivalent to 


oj-span ^ Af. 


E 


(w(G(x, lUo)) - < a0E 


,'yF{x,h,Wo)+f{G(x,Wo)) 
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For simplicity let Z := 'yF{x, h, Wq) + f{G{x, Wq)). It is enough to prove that 

E [1^ {co{G{x, Wo)) - Mx)) e^] < [e^] , 

where A = {a;(G(x, Wq)) — cj)u:{x) > ^}, as the inequality 

E [l^c (a;(G(x, Wq)) - M^)) e^] < ^E [e^] 
is trivial. Using Schwarz inequality we get 1 < E[e“^]E[e^], so it is enough to show that 

E [1a (w(G(x, lUo)) - 4>‘^{x)) e^] E [e~^] < (4.21) 

Multiplying both sides of (4.21) by using the fact that y < for any y > 0, and 

inequality prove (4.20), it is sufficient to show that 


E 


J^^(!^fbp^\ ‘^(G(x,Wo))-cl>uj{x)) z] p r -zi ^ 


(4.22) 


Using (A.4) and Schwarz inequality we get 


E 




< E 


[a.l{Wo)-{<i>-bi)uj{x)\ 






SO instead of (4.22) it is enough to show that 


V V ((^ — hi) 

Let us prove (4.23). Due to (A.4) we know that 


(4.23) 



4{Mbi—~ib2) 


ai{Wo) 


< oo. 


(4.24) 


On the other hand, from the fact that ||/||tj-span < M, we know that there exists a £ M such that 
11/ + “IL < M. Consequently, recalling that Z = 'jF{x, h, Wq) + f{G{x, Wo))) using monotonicity 
of the exponent function and (A. 4), we get 



< 



2l'rFix,h,Wo)+{f{Gix,Wo))+a)-a]j 
2[—'ya2iWo)—'Yb2Uj{x)+M{ai{Wo)+biu){x)+l) — 


a]j 


= g(M 6 i -'yb2)u](x)+M-a ^^yg 2 [Mai (Wo)-7a2 (VKo)]] ^ 
E[e“^] = ^e,-bF{^FWo)+U{G{x,Wa))+a)-a]^ 

< ]E(g“ 7 “ 2 (Wo)- 762 t<.’(a:)+M(ai(Wo)+ 6 ia;(x)+l)+a]j 
— g(M6i-762)t<j(a;)+M+ag|-gMai(Wo)-7a2(Wo)j 


(4.25) 


(4.26) 
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g- 2 (M 6 i- 762 ) 1 ^( 3 ;) [e“^] = e^^y^E[e2[^“i(^o)“'>'“2(VKo)]]]g[gA4'ai(VKo)-7a2(Wo)j ^ (4.27) 

Combining (4.27) and (4.24), we get that (4.23) will hold for large enough. In other words it is 
enough to choose a^, such that 

-—< a^. (4.28) 

This concludes the proof of (4.20). □ 

Lemma 4.6. Let 7 < 0. Under assumptions (A.1)-(A.5), for any fixed M > 0, a (^i,l) and 
Off) > 0, there exists fi G (0,1) and L G (0,1) such that 

l|EIx,ylUar + + (t>io{y) + 2a<^) < L(2 + / 3 w(x) + I 3 uj{y)), (4.29) 

for any x,y G M*' and f,g e ^(M*') satisfying \\f\\uj-span < M and \\g\\uj-span < M. 

Proof. Let us fix M > 0, 0 G (fei, 1) and > 0. Let 7? G M be such that 

R>^- (4.30) 

We will consider two cases; 


(a) uj{x) + uj{y) > R, (b) a;(x) + a;(y) < 7?, 

and find fi < 1 and L G (0,1) such that (4.29) is satisfied both on {a;(x) + uj{y) > R} and 
{uj{x) +uj{y) < R}. 

Case a) Noting that ||]HI^’J||var < 2, it is enough to find fi < 1 and L G (0,1) such that 

2 + (3{(j)uj{x) + 4>uj{y) + 2q;</,) < L(2 + /3uj{x) + /3uj{y)), (4-31) 

for any x,y G M^, such that uj{x) + uj{y) > R. We will show that in this case for any 
/3 < 1 we could find L G (0,1) such that (4.31) holds. Let /3 < 1. We know that (4.31) is 
equivalent to 

2 + 2(3a^ <2L + fl{L - 4>){uj{x) + w(y)). 

Let us assume that L > fi. Then, it is sufficient to show that 


which is equivalent to 


2 + 2fia^ <2L + I3{L - ct>)R, 
2 + j3[2a^ + (pR) ^ ^ 


2 + /3R 

Consequently, using (4.30), it is enough to choose any L < 1 such that 


( [ 2 + I3{2a^ + (pR )'[ 

— 2Tm —/ 


(4.32) 


(4.33) 
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Case b) Let Cr ■= {ix,y) € x : w(x) + uj{y) < i?}. It is sufficient to show that there 
exists /? € (0,1) and L G (0,1) such that for any {x,y) G Cr and f,g€ satisfying 

ll/IU-span < M and Hfi'IU-span < M, we get 

IPx’yllvar + f3i4>R + 2a0) < 2L. 


In fact, it is enough to show that 


sup WlilUr < 2. 

{x,y)eCji 

Indeed, then it is enough to choose any /3 < 1 such that 

2 — SUP( 3 ,^j^)gc'^ ||EIx’|||var 

(pR + 2a^ ’ 

and consider any 

. ( SUP(a:,j;)GCfl P^’lllvar + /3{(t>R + 2a^) \ 

H ^ ’ J- 


(4.34) 


(4.35) 


On the contrary, let us assume that (4.34) is false. Then, there exists a sequence 


(^n; Uni fni Qn-t -^n)nEN; 


for {Xn,yn) G Cr, fn,gn G Cuj{R^) and G such that ||/n|| LJ-span ^ M, II 5 JI,< 


yrx||LJ-span 


M and 


(4.36) 


Due to (4.36) we know that 

0 Und (A„) —> 0. (4.37) 

Next, for any x G h £ U, f £ Ctj(M^) and A £ ;B(M^), such that uj{x) < R and 
ca-span < M, using Schwarz inequality we get 

ror-i 'r[F{x,h,Wo}+^fiG(x,Wo))h 

Jh[l{G(x,VUo)GA}e 1^1 J 


Qix,f,h)iA) - 


^^^'r[F{x,h,Wo)+-^f(G{x,Wo))]^ 


> 


> 


> 


E[e 

lE[l{G(x,vUo)GA}e 


^[F{x,h,Wo)+TFf{G{x,Wo))h 


^^[F(x,h,Wo)+TFf{G{x,Wo))h 


J^J E[e~ hT" 

X[F(x,h,Wo)+jFf(Gix,Wo))] -XlF(x,h,Wo)+jFfiG(x,Wo})h2 


^^^^lFix,h,Wo)+^^f{G{x,Wo))]^^^-y[F{x,h,Wo)+-^f{G{x,Wo))h 


lE[l{G(x,M/o)eA}]' 


g2[(M6i— 7 fe 2 )a;(a;)+Af]]g|'gMai(Wo)—7a2(Wo)j2 


1 E[ 1 {G(x,VUo)gA}]' 


g 2 [(M 6 i— 7 fe 2 )^J+M]]g|'gMai(Wo)— 7 a 2 (Wo) j2 ' 


(4.38) 
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Combining (4.37) and (4.38), we get that 

lE[l{G(x„,M^o)e^ 5 i}] 0 and E ^ 0. 

On the other hand, from (A.5), for any n G N and (x„,y„) G Cr, we get 

E[l{G(a;„,Wo)e^ 5 i}] +®[l{G(t/„,iyo)eA„}] > + cn{An) = c> 0, 

where c and v satisfy (2.6), for Cn. This leads to contradiction and in consequence 
concludes the proof of Case b). 

We are now ready to prove (4.29). Indeed, combining (4.33) and (4.35) we conclude that for a 
given M > 0, (/> G (6i, 1), > 0 and i? G M satisfying (4.30), it is enough to choose (3 < I and 

L G (0,1), such that 

a ~ l|BI®’yl|var 

+ 2a<ji ’ 

®'^P(a:,y)gGfl ll®Ia;,i/||var + + 2 q:(^) 2 + /3(2q;0 + 4^^) 

2 ’ 2 + (3R 

This concludes the proof of (4.29). □ 

We are now ready to prove Theorem 4.3. 

Proof of Theorem 4-3. Let 7 < 0. Combining Lemma 4.4, Lemma 4.5 and Lemma 4.6 we know 
that for any fixed M, there exists /3(M) G (0,1) and L{M) G (0,1), such that 

3^~ffi^) ~33'yg{x) — {T^f{y) — T^g{y)) ^ \\f ~ 9\\l3{M),uj-spa,n\\^x,y\\g[M),LLj-va,r 

2 +/3{M)uj{x) + l3{M)uj{y) ~ 2 +/3{M)uj{x) +/3{M)uj{y) 

< L{M)\\f - g\y^M) ,LL?-span; 

for any f,g G C^(M^) and x,y gR'^ satisfying H/IU-span < M and ||fif|U-span < M. Consequently, 
for any fixed M, there exists (3{M) G (0,1) and L{M) G (0,1), such that 

11 ^ 7 / “ ^75'll/3(M),a;-span < A(M)||/ — fi'll/3(M),tj-span) 

whenever ||/||a)-span < M and ||(7||aj-span < M- This concludes the proof of Theorem 4.3. □ 

Corollary 4.7. For a given 70 < 0 there exists [3 : M+ —)• (0,1) and L : M+ —>■ (0,1), such that for 
any 7 G [ 70 , 0), operator is a local contraction wrt. fl and L, i.e. for any 7 G [ 70 , 0 ), we get 

11 ^ 7/1 ^ 7/2 ||/3(Af),a)-span — A(ilL)||/i /2 ||/3(Af),a)-span! 

for /i,/2 G C(M^); such that \\fi\\uj-span < M and \\f2\\uj-span < M. 



L > max 
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Proof. The proof of Corollary 4.7 is a direct consequence of the proof of Theorem 4.3. For trans¬ 
parency, let us briefly explain the idea of the proof. 

For clarity let us fix M > 0 and consider L(M) € (0,1) and /3(M) € (0,1). Let «<;(,> 0 be such 
that (4.28) is satished for 70 , i.e. 


a<j, > 


Mbi 


- 61 ) / 


E[e ('^-* 1 ) 


j£jg2[Mai(Wo)-7oa2(Wo)]jEjg-^“l(M^o)-7oa2(Wo)j^ 


and let R be such (4.30) is satished for 70 . Then, for any 7 G [70)0) we get 


o 2 M/ 


> 




Mbi 


E[e ('^-<> 1 ) 


E[e2['^“i('^o)-7a2(Wo)]]E[e'^“i('^°)“'>'“2(VVo)j_ 


Consequently, the choice of and R will guarantee (4.28) and (4.30), for any 7 G [ 70 , 0 ). 

Next, we know that /3(M) and L{M) are chosen in such a way that (4.39) is satished for 70 , i.e. 


2 SUP(3,^j^)g(7^ ||lHIx,|||var 


/?< 


L > max 


(j)R “t" 2,cX(p 

supj'j, ||Hx’f/||var + /3{4>R + 2a(^) 2 -t- fKfZa^ -)- (f>R) 
2 ’ 2 + ^R 


Thus, it is sufficient to show that we could hnd a constant a G (0,2) such that 

sup < Q 

{x,y)£CR 

for any 7 G [70)0). To do that it is enough to notice that the lower bound for Qi^x,f,h) introduced 
in (4.38) is in fact decreasing wrt. 7 . □ 


Using Theorem 4.3, i.e. contraction property of operator Ty, one can solve Bellman equa¬ 
tion (4.3) and (4.1). 


Proposition 4.8. Under assumptions (A.1)-(A.5), there exists 70 < 0, such that for any 7 G 
( 70 , 0 ), there exist a unique (up to an additive constant) u^y G Ci^(R^) and Ay G M, the solutions to 
Bellman equation (4.3). 


Proof. Let us hx 7 < 0 and let M := g^{a 2 {Wo)) — {—a 2 {Wo)) + 62 . We know that for any 

7 G [ 7 , 0 ) we get ||i?. 70 ||a;-span < M, as 


11 .^7 011 tj-span ^ sup 

< sup 


g'^{a2{Wo) + b2Uj{x)} - /i^(-a2(VFo) - b20j{y)) 
2 -I- uj{x) + uj{y) 

pP{a2{WQ)) - g<{-a2{WQ)) + h20j{x) + b20j{y) 
2 -I- uj{x) + uj{y) 


< /i°(a 2 (kFo)) - tiH-a2{Wo)) + 62 . 
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For the operator and M, let I3{M) and L{M) denote corresponding constants from Theorem 4.3. 
For simplicity we will write /3 and L, instead of (3{M) and L{M). Let 

70 := max{ 7 , -|/3(1 - L)\} (4.40) 

Noting that 70 € (—1,0) and nsing Corollary 4.7, for any 7 € ( 70 ,0), we know that 


11^7/1 ^7/2 11 / 3 ,oj-span ^ / 2 ||/ 3 ,a;-span) 


(4.41) 


for /i ,/2 € C(M''), such that ||/l ||a;-span < ]\L and ||y*2||a;-span — H/f . 

As I 7 I < /3(1 — L), it can be easily shown that for any n G N we get ||T(*0||ij_span < M- Indeed, 
using (4.41), we get 

||r-y0||t^_span = ItI ||-R 70 |U-span < ItI^ < M, 

||r 2 o|Upan< ||t 2 o-t,o||^ 

,aj-span + \m^\\/3 ,a;-span — ||r^0||^,,.span(^ + l) 

bl I7I 

— ^ ||-^70||/3,aj-span ^ ^ ||-R 70 ||i.J-span ^ Af, 

||r30|U_span < IIT^O - T^O\\0 ,a;-span + ||t2o-t,o||^ 

,aj-span + \mo\\0 ,a;-span ^ ||T^0||^,,.span(A2 + L+l) 

I7I I7I 

< 2 _ ^ l|-^70||/3,a;-span < - L) ^ Af, 

...<... 

||7"”0||ta_span < ||?70||/3,aj_span(A” ^ + . . . + L + 1) < ||7?-j.0||tj-span < Af. 


Using Banach’s fixed point theorem (see e.g. [17, Appendix A]), we know that there exists at 
most one fixed point of Ty in Cta(M^) endowed with the cj-span norm. Exploiting the fact that 
llT’y 0||ij_span < Af for any n G N and the local contraction property of Ty we conclude that there 
exists a unique Uy G C[a(M^) (up to an additive constant), such that 


llTyny riy ll^^ta-spaii — 0. 

Consequently, for a fixed a G M^, the constant Ay := u^[a) ^ Ci^;(M^) are solutions 

to Bellman equation (4.3). 

Thus, the constant Ay := i?yny(0) — ny(0) and Uy G Ci^(M^) are solutions to Bellman equa¬ 
tion (4.1). □ 


In the end of this Section, let ns show a corollary, which will be helpful later. To do so let us 
fix a G and define tty( 3 :) := Uj{x) — u^{a) for x G M^. 

Corollary 4.9. Under the assumptions and notation of Proposition 4-8 the functions (70,0) 9 7 i->- 
Ay and (70,0) 9 7 i-)- tty(x) for each x G M*’ are continuous. 

Proof. Clearly when Uy is a solution to (4.3) then tiy is also a solution to (4.3). By (4.41) and the 
proof of Proposition 4.8 we have that ||hy||ij-span < M and 

|Ty”T(x) - hy(x) - Tf^fl{a)\ < M(L(M))”^(2 + /3{M)uj{x) + /3{M)io{a)) 


(4.42) 
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for any x G and 7 from a compact subinterval of ( 70 ,0). By Proposition 4.2 for each m and fixed 
X G the mappings 7 —>■ T™0(x) and 7 T™0(a) are continuous. Therefore when 7 ^ ^ 7 < 0 

we have, using (4.42), that 

lu^jx) - u.,(x)| < |r- 0 (x) - r 70 (x)| + |r- 0 (a) - r- 0 (a)| 

+ 2M{L{M)r{2 + f3{M)uj{x) + /3{M)uj{a)) = an,m + + c^- (4.43) 

For a given e we can choose m such that Cm < e. Then letting n —>■ 00 for fixed m we obtain 
continuity of the mapping 7 —)• u^{x). Following the proof of Proposition 4.2 we can also show that 
the mapping 7 — T^u^{x) is continuous. Consequently, the mapping A —)• A.^ = u^{x) 

continuous, which completes the proof. □ 


5 Optimal strategy 


It is straightforward to check, that under the assumptions and notation of Proposition 4.8, we get 
that v^{x) = IkrM and are solutions to Bellman equation (4.1). Finally, we can link Be llm an 
equation (4.1) and (4.3) to our initial problem (2.8). 

Proposition 5.1. Under (A.1)-(A.5), there exists 70 < 0, such that for any 7 G ( 70 , 0 ), we get 

> sup 
H€A 

i.e. the optimal value in problem (2.8) does not exceed the solution of Bellman equation (4.1). 
Moreover, if oi in the assumption (A. 4) is bounded from above, we have that the optimal value 
in (2.8) is equal to and the optimal strategy is defined by selectors to the Bellman equation 
(4.1). 


Proof. This proof could be considered as a variation of the classical verification theorem from the 
theory of Risk Sensitive Control (see e.g. [16, Theorem 2.1]). Let 70 be given by (4.40) and for 
7 G ( 70 , 0 ), let u.y and A.y denote the solutions of Bellman equation (4.3). 

First, we need to show that A-,, is an upper bound for any 7 G ( 70 , 0 ), i.e. that for any adapted 
strategy H = (iLt)teT, we get 


A.^ > liminf —n'^ 

^ ~ t^OO t 




For f G T and p > 1, such that 7 > p 7 o, using (4.3), we have 


uMX) 
e p 


< E[e p ^ p ^ \Fi\ 


(5.1) 


Consequently, using the tower property, we get 


tx 

e 


< E[e 


W 7 {Xt)—uj 

p p 


(^o)+JE*=o FiXi,Hi,Wi) 
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for any f € T. Equivalently, for u-y(x) = , we get 


A, > (y^FiXi,H,,W^) + vxiXt) - V 2 {Xo)] . 

\i=0 / 

It is hard to get rid of v taking the limit, in the above inequality (note, for the case of bounded v 
it is straightforward). Using Holder’s inequality we know that for q = p/{p — 1) we get 


, 1 
At > — 
p t 


't-l 


Y, F{Xi, H,, W^) + (vxiXt) - V 


p=o 


and consequently (for any p > 1 ), since ut (Xt)—UT (Xq) < M( 2 +w(Xt)+a;(Xo)) andlim^^oo 

p p ^ 

0 we have 


p 

t-i 


At > liminf -p^ \ Hi, W, 

p t—>-oo t ' 


Ki=0 


By continuity of 7 —>■ A..y (see Corollary 4.9 ), we have that limp_>.i At = A..y, which shows (5.1). 

Second, we show the optimality of the strategy defined by the Bellman equation (4.1), when oi 
in (A.4) is bounded from above by a. Let us fix 7 G ( 70 ,0) and let M > 0 be such that ||u.Y||a; < M. 
For the strategy H determined by the Bellman equation (4.3), using monotonicity of p^, we get 


't-i 


Y = FiXi, H„ W,) + v^iXt) - v^iXo) 


7=0 

't-i 


< T/iM ^ FiXi, Y, W,) + M{u{Xt) + 1) - v^{Xo) 


7=0 

't-i 


- lU,) + M ^ UYaiiWtY + b\u{Xo) + 1 - v^{Xo) 


7=0 

't-i 


i=l 




M ^+a;(Xo) + l - v^iXo) 


0=0 


Letting t ^ 00 we obtain (taking into account (5.1)) 


1 

A^ = liminf -p'^CY. FjXj, Hj, Wj)) 

t^oo t ^^ 


i=Q 


which completes the second part of the proof. 


□ 


6 Exemplary dynamics 

In this subsection let us present examples of dynamics for which assumptions (A.1)-(A.5) are 
fulfilled. 
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Example 6.1. In this example, we shall set w = 0 (equivalently, one might say that uj is bounded) 
and show that our framework covers a wide class of dynamics in the classical case. The hrst example 
is taken from [25]. We will assume that time T = is continuous, but we can only reshape our 
portfolio in discrete time moments n G N. For n G N and (z = 1,... ,k + m), let us assume that 
denotes the trajectory of Wz{t) — Wzin) (n < t < n + 1 ), where {wz{t)}^^'^'^ are independent 
Brownian motions (which generate the hltration). Let us assume that the dynamics of the risky 
assets and factors is given by 

k+m 

xi = bj{Xn-i) + ^ Sjz[wz{n) -Wz{n- 1 )], 

Z = 1 

jqi fc+m 

= ai{Xn) dt+'^ Oiz dwzit), 

Z=1 

where for {i = 1,... , m), (j = 1,... ,k) and {z = 1,..., A: + m): Oj, ^ M are measurable 

and bounded functions, 6* is continuous, 6jz G M, Oiz G M and rauk{{aiz)z=i,...,k+m) = k. Let hi{t) 
denote the part of the capital invested at time t in the z-th risky asset and let 

m 

17 = {(hi,...,h^) G [ 0 ,ir : = 

i=l 


n G N, 
t £ [n, n + 1 ), 


Moreover, let LL^ = hi{n). Using Ito’s Lemma (see [25] for details) we get function F of the form 

^ rn+l 1 /c+m ^ \ 2 

F{Xn,Hn,Wn)= Y. a,{X^)hi{s)ds--Y ( hi(s)c 7 , J ds 

i=l ^ 2 = 1 ^ i=l 

m+l "1 k+m 

+ / y~]hi(s) aizdwzjs). 

i=l 2=1 


One can check that assumptions (A.1)-(A.4) will hold in this framework, for w = 0. See [25], where 
in fact equivalents of all Propositions from Section 4 are directly proved. For clarity, let us show 
the existence of the upper bound in (A. 4), for function F. We get 


F{Xn,Hn,Wn) = ln 


Vn+1 

Vr,. 






n+1 


2 = 1 


5* 


In^ o-i4wzin+l)-w4n)] 


2 = 1 


fc+m 

< sup (ai{Xn) + Y criz[wz{.n + 1) - Wzin)]) 

l<i<m 1 

— — Z = L 

< jjallsup + Ikllsup max [wz{n + 1) - Wz{n)], 

l<z<k+m 


where ||a||sup = supi<j<^ sup^-gR/^ |ai(x)| and ||u||sup = supi<j<^ supi<^<fc+^ \aiz 
Thus, is is sufficient to set any 62 > 0 and 


a2(tc) = ||a||sup + Ikllsup max \wz{n + 1) - Wz{n)\{w). 

l<z<k-\-m 
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Note, it is easy to check that 02 will satisfy (2.4), as for a Gaussian X, we get G L^. Moreover 
( 2 . 2 ) follows from boundedness of b while ( 2 . 6 ) from nondegeneracy of a and boundedness of b and 
in fact one can find a constant c uniform for all x € M^. In this example a solution to the Bellman 
equation (4.1) is bounded and therefore we obtain in Proposition 5.1 that A..y is the optimal value 
without additional assumptions. 

Example 6.2. We shall now generalize previous example. Namely, let 


G{x,W) = B{x) + C{W), 


where 5 : —>• is such that ||i?(x)|| < A + 6 i||x|| with 61 < 1 and C : —)• is bounded 

from above of the form 


with K > t). Then 


( k+m 


C{Wn) = min ^ (5j>['w^(n) - Wz{n - 1)], K \ , 


I Z=l 


Xn=B{Xn-l) + C{Wn), 

dsi k+m 

= ai{Xn) dt + ^ (Jiz dwz{t), t e [n,n + 1), 

Z=1 

where we assume that ||aj||(j < 00 . Choosing w(x) = a + 6 i||x|| one can check that all assumptions 
(A.1)-(A.5) together with boundedness from above of ai in (A.4) are satisfied. In particular, 
assumption (A.5) is satisfied uniformly in x G from compact sets due to the form of G{x, W) 
and G{Wn)- 


Example 6.3. Let us assume that assumptions (A.l) and (A.2) hold and the dynamics of i-th 
risky assets is given by 


Sl+i 

SI 


= ^i(Xt,Wt), 


for any t G T, where is a measurable vector function. Moreover the set U will be of the form 
{(hi,..., hm) G [0,1]™ : 1 hi < 1}. Then we can define F explicitly, as 


F(A„, Hn, Wn) HiUXn, H^n) + (1 - h?* ) . 


^ 2=1 


2=1 


To get assumptions (A.3) and (A.4) we need to impose additional assumptions on W and In 
particular we can consider the discretized version of Example 6.1 by setting = Wi{n + 1) — Wi{n) 
and 

^ k-\-m k-\-m 

r(A„, Wn) = exp [a,{Xn) - 2 E + E ^-^4' 

^ Z = l 2=1 

See [26] for details in general case and [10] for the case when (6.1) holds. 
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